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How important are supplementary materials in instruction? This study 
suggests that such an approach contributes signijicanlly to the development 
of critical thinking and science understanding. 



Three Emphases in Teaching Biology— A Statistical 

Comparison of Results 

Robert E. Yager and John W. Wick 
University of loiva, loiva City, Iowa 



Introduction 

This is a report of a study conducted at the 
University of Iowa Laboratory School during 
the 1962 and 1963 academic years. The 
purpose of the study was to determine if it is 
possible to affect a student’s understanding 
of science and his ability to do critical think- 
ing by altering the emphases of the teacher in 
the classroom. 

The course was taught at grade eight 
which is where the general education course 
in biology is taught in the school. The 
rationale for the Junior high program has 
been described previously^ and an outline of 
the course appeared in the secondary cur- 
riculum guide for 1962.® In general, the 
course can be desiTibed as one emphasizing 
the molecular level of biology and incorpo- 
rating laboratory experiences to a high de- 
gree. Three teachers were used for each of 
three sections. The teachers worked closely 
together as a team and shifted from seidion 
to section periodically to teaidi various units 
of work. This was designed to reduce the 
teacher, variable in the study. Each section 
of students spent the same amount of time 
with each unit, experienced the same labora- 
tories, took the same examinations, and in 
general, were treated identically except for 
the variables reported in this study. 

One section utilized only a textbook and 
the accompanying laboratory. This group 
is referred to as the TL group in the study. 
The textbook and the laboratory suggestions 



were the paperback editions of the second 
writing of the BSCS Blue Version material.'^ 
No other books or any other investigations 
were used with the group. The teachers 
avoided discussions of differences of opinion, 
interpretations, and reports of new findings. 
At times the material in the textbook 
touched upon these facets. However, class 
discussions avoided these areas. The em- 
phasis was uponmastery of basic (foncepts as 
identified by the authors through an iii(|uiry 
approach in the laboratory. 

The second section utilized the same mate- 
rials with the addition of all kinds of paper- 
backs, textbooks, various references, and 
excerpts from original works. Several spe- 
cial materials were paraphrased, dupli(*ated, 
and used as handout material for the group. 
There was never any reference made to a 
textbook. Spe(*ifi(! authors (or book in the 
case of the BSCS text) were identified when 
such information and authority was added to 
a discussion. Although the same unit se- 
(pience was used, a (*ontinuous effort was 
made to avoid identifying this seiiuence with 
a given textbook. All of the laboratory 
guides were prepared as single handout 
sheets, unrelated to a book. At times, 
student suggestions for additional procedures 
were added to the guides. Hence, there was 
an added involvement in planning the lab- 
oratory phase which was missing com.pletely 
from the TL group. The teachers in the 
multi reference-laboratory group (the MRL 
group) avoided reference to the controversy 
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which often occurred among the men respon- 
.sible for the formation of fundamental 
theories. Attention was given oidy to the 
varying interpretations given by modern 
writers. No attention was given to the 
history involved with new discoveries and 
new ideas through the ages. 

The third group in the study resembled the 
MRL group in the addition of (constant 
attention and concern for the men involved 
with the development of the important ideas 
of the sciem^e. The teachers made a con- 
scientious effort to show the me(!hani(!s of 
how the major ideas evolved. Constant 
reference was made to the major contribu- 
tors with attention directed to their specific 
statements. Some time was spent dis- 
cussing the (!ulture of the time when the 
contributions were made. Again the same 
laboratories were utilized except that empha- 
sis was placed on how this experiment would 
have been viewed by various people at vari- 
ous times in history. Then, emphasis was 
placed on how the major ideas were formed, 
changed, and finally perfected as we know 
them toda3^ Some attention was given to 
how today’s ideas will likely (diange in future 
years. The tea(>hers in this group utilized 
the spirit of inquiry in the laboratory to 
emphasize it as the te(‘hnique employed by 
the major contributors of the big ideas in 
biology. This group was termed the iNIRLI 
group (multirefereiK^e-laboratory and idea 
group). 

The three teachers had similar training 
and philosophy. They were ea(‘h com- 
mitted to doing the best job possible with 
ea(ih of the groups within the confines of the 
study as described. Each was interested in 
the results of the study and was involved 
with its planning as well as the implementa- 
tion phases. However, none had a precon- 
ceived notion of the out(!omes as reported 
here. The students were told that they were 
involved in a study. They realized that 
there were varioPs emphases in the three 
sections. However, they were not aware of 
the precise problem under investigation, the 
method of attack, or the final outcomes. 



Involvement in sindi studies is a regular 
occ.urrence in the laboratory scthool. Hemie 
the so-called “Hawthorne effecd’’ is mini- 
mized. 

The Measurement Instruments 

Three aspects of the student’s growth were 
under surveillance in this study. The three 
aspects were understanding of sc.iemie, .skills 
in critical thinking, and mastery of (iontent. 
They were measured with the following in- 
struments, respectively : 

(1) Test of Understanding Science 
(TOUS) 

{2) W atson-Glaser Critical Thinking Ap- 
praisal;’’ 

(3) Nelson Biology Test.^ 

Preconditions to the Results 

The stati.stical handling of the re.sulting 
data was based on an analysis of covariaiuie, 
(do.sely following the exposition pre.sented by 
Lindqui.st.^ As mentioned in this exposition, 
compliance with certain (“onditions is re- 
(juired before the re.sults can have any mean- 
ing. These conditions are as follows: 

(/) Random selection of treatment groups 
must be assured. Since division of the 
seventy available students into the three 
cla.sscs was done on a random basis, chance 
variations in motivation or other elements 
affecting performance .should have cancelled 
each other. 

( 2 ) The prete.st S(>ores mu.st be unaffected 
by the measures, which was assured by ad- 
ihini.stering the original te.st during the first 
week of cla.ss. 

(3) The regre.ssion of the postte.st scores 
on the prete.st scores mu.st be the same for all 
treatment populations. The results of this 
te.st are tabulated in Table I. It can be seen 
that in each case they are nonsignificant. 

(4) It is nece.ssary that the regre.s.sion in 
each case be linear. This was examined 
using the F te.st ratio of mean square for 
departure from linearity over mean square 
within. In each case, the hypothesis that 
the pre- and po.st-te.sts were related in a 
linear manner could not be rejected. 
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TABLE I 

Results for Tests of Homogeneity of Regression for the Three Instruments 



Instrument 


df 


Mean square 


F 




. 01 ^ 2,04 


Tons 












Among group 


2 


14.6069 


1,2454 




>4.98 


Dev. from group 


64 


11.7291 








Watson-Glaser 












Among group 


2 


43.3137 


2.6245 




>4.98 


Dev. from n 


64 


16.5037 








Nelson 












Among group 


2 


1.0803 


0.0952 




>4.98 


Dev. from grou)) 


64 


11.3527 












TABLE II 








Aualy.sLs of Covariance 


Results for the Test of Understanding Heience 




Hources df 


ss X 


sp XY ss Y 


ss Y' 


df 


ms Y' 


Treatments (A) 2 


21.4863 


-92.4746 495.7441 


694.3797 


2 


347.1899 


Within (2) 67 


4383.7852 


4289.8184 4977.7422 


779.8765 


66 


11.8163 


Total 69 


4405.2715 


4197.3437 5473,4863 


1474.2562 


68 





{6) The dintributioii of adjusted scores for 
each treatment population must be normal. 
This is assumed to be xhe case. 

(6‘) The distributions in each (Uise must 
have the same variance. This was tested 
using Bartlett’s test for homogeneity of 
variance, and the results in eac^h case were 
nonsignificant. 

The Results 

Table II, concerning the understanding of 
science, indicates statistical results. Under 
the hypothesis that there is no difference in 
the student’s performance on the TOUS test 
(that is, their under.standing of science is 
unaffected by the method of presentation), 
the following result is obtained : 

F(2,Q7) = 29.3823, where F,% — 3.14; 

Fm = 4.95 

Thus the hypothesis that there is no differ- 
ence can be rejected. Now the different 
pairs of groups can be examined more closely 
to see wherein this significant difference lies. 
The independent variable means X, criterion 
variable means F, and adjusted criterion 
variable means F' are listed in Table III. 



TABLE III 

Analysis of Covariance Results for the 
TOUH Test, Control, Criterion, and 
Adjusted Criterion Mean Value, s 

TL SI MRTJ 

A means 28.8696 28.7917 27.6522 

F means 29.8261 33.0417 36.3913 

F' means 29.4085 32.7003 37.1650 



The I test comparing the three possible 
pairings indicates (at the 0.01 level) that the 
MllLI method is significantly superior to the 
other two, and that the TviRL is signifitiantly 
better than the TL method. This, of course, 
is based on the premise that the TOUS really 
does measure ability to understand science. 

Table IV indicates results concerning the 
ability to do critical thinking. Apparently 
the hypothesis that there is no difference in 
the student’s performance on the Watson- 
Glaser Test of Critical Thinking must be re- 
jected. Therefore, the groups must be 
examined more closely to determine where 
the difference exists. The independent ^ 
variable means X, criterion variable means 
F, and adjusted criterion variable means F' 
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TABLE IV 

Analysis of Covariance llesuUw for the Watson-Glaser Test of Critical Thinking 

Sources dj as X sp XY as Y aa Y' df ma Y' 

Treatmente(A) 2 205. 7715 -167.5137 313.1621 802.7520 2 401.3760 

Within (W) 67 7604.5203 7250.0141 8056.6004 1142.8673 66 17.3162 

Total 60 7810.3008 7083.4004 8360,7715 1045,6103 68 

/'’(2.66) « 23.1703, where « 3.14; - 4.05 



are given in Table V. The t te,st (!omi)ari,son 
for the three po.snible pairs indicate that both 
the AIRL and Ai'RLI are significantly supe- 
rior to the TL nudhod. 

Table VI indicates results coiKHirning the 
ability to retain i’actual knowledge in biol- 
ogy. With this data, 7^(2, fifi) = 0.0015, 
which is nonsignificant. Thus the hypothe- 
sis that there is no difference in the student’s 
ability to learn and retain factual informa- 
tion because of the different methods of 
piusentation cannot be rejected. There is 
no reason to pursue the data further because 
of this result. 

TABLE V 

Analysis of Covariance Remits for the Watsou-Glascr 
Te.st of Critical Thinking, Control, Criterion, ami 
Adjusted Criteri(,n -Mean Values 

TL MRL MRU 

A'' means 45.3043 42.9167 41.0870 

F means 49.8696 55.0000 53.0000 

F' means 47.7677 55.1748 54.9194 



Discussion 

The role of the teacher in setting the tone 
of the classroom is an important facdor in 
determining student out(!omes. Although 
this study does not demonstrate that the 
teacher can affect the degree of masterj of 
concepts and facts of biology, this has been 
demonstrated in another earlier .study when 



the teachers involved were more variabk*.” 
Becmuse of significant differences in tin* 
results with the insvruments used in this 
study, the {jue.stion of other diff(‘rences in 
.student out(!oni(!s that may 0(*cur b(‘cause of 
tea(!her emphases not nKuisured with thc.se 
in.struments at once arises. Then* is also the 
(lue.stion of whether thc'se same results could 
occur wIk'II le.ss skilk'd teachers were in- 
volved. Certainly tin? teachers involved 
here were ‘''dter than average*. They 
averaged live yeui.i of exp(*rienc(* and a con- 
tent background consisting of fifty .semester 
hours in biology at the graduate level, In 
addition, all had training in the hi.story and 
philosophy of science*. 

In many ree'cnt reports of re*se*arch in 
se*iene‘(* teaching, the e*ffect of the* teacher 
upon learning is minimize*el. In fact, large 
numbers of teachers inve)lve*el in a stuely are 
thought to be a e‘e)iitrol e)f the teache*r 
variable*. When specifie* e*mphase*s in the 
e^las.sroom can so alter experimental re.sults, 
as reported he*re, this experimental de.sign is 
e*ertainly ejue.stioned. In faed, certain pos- 
sible oute'omes in partie-ular .studies may be 
completely hidden. 

Conclusions 

Certain .student outeiomes are demon- 
strated to be greater with certain teacher 



TABLE VI 

Analysis of Covariance Results for the Nelson Biology Test 

Semrees df as X sp XY as Y ss Y' df ms Y' 

Treatments (A) 2 4.1533 3.4902 2.9404 0.0336 2 0.0168 

Within (W) 67 8056.1328 7409.7959 7544.0459 728.7319 66 11.0414 

69 8060.2861 7413.2861 7546.9863 728.7655 



Total 



68 
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emphuses In teaching biology at the necond- 
ary level. Specific (!onclusioii.s follow. 

(1) UKing a multireference approac^h in the 
biology clas.sroom cau.se.s Ktudents to develop 
more .skill in (u-itical thinking than when a 
.single textbook is used with the same labora- 
tory inve.stigationis (as niea.sured by the 
Watsori-Glaser Critical Thinking Appraisal). 
This observation is significant at the 0.01 
level of confideiKte. 

(S) A multireference approach is ecjually 
superior to a single textbook-laboratory 
approach in (tausing .students to understand 
science to a higher degree (as measured by 
the TOUS test) . Again, this is significant at 
the 0.01 level of confidence. 

(S) Th(‘ multircd’erence-laboratory ap- 
proach with an added emphasis upon how 
the i(l('as were formed and upon the men 
primarily responsible for tin; ideas caus(?s 
students to understand science (as measured 
by the TOUS) at an even higher level. This 
is significantly greater than the TL or the 
AIRL method at the 0.01 level of confidence. 

(4) There is no .significant differemte in the 
mastery of the major concepts and facts of ' 
biology (as measured by the Nelson Biology 
Te.st) by the students among the three 
emphases used by the teachers of the study. 

(»5) Teacher emphasis in the cla.ssrooin is 



identified as an important facdor in determin- 
ing student out(iomes in the teaching of 
general eductation biology. Various em- 
phases (tause varying degrees of understand- 
ing of the meaning of sc-ience and the devel- 
opment of skills of critical thinking by the 
.students enrolled. 
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